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A search for the nonconservation of lepton flavor number in the decay r — > /« 7 has been 
performed using 2.07x 10 s e + e _ — > t + t~ events produced at a center-of-mass energy near 10.58 GeV 
with the BABAR detector at the PEP-II storage ring. We find no evidence for a signal and set an 
upper limit on the branching ratio of B(t ± — > /i ± 7) < 6.8 x 10~ 8 at 90% confidence level. 

PACS numbers: 13.35.Dx, 14.60.Fg, 11.30.Hv 



Decays violating lepton flavor number, if observed, 
would be among the most theoretically clean signatures 



of new physics and the decay r 



(i 7 is one such 



process. It is expected with rates as high as several parts 
per million in some supersymmetric models 0,0] > despite 
the stringent experimental limit on the related fi^ — > e ± 7 
decay ■ In a modest extension to the Standard Model 
(SM) incorporating finite v masses 0, the branching ra- 
tio is many orders of magnitude below experimental ac- 
cessibility |]| , and so an observation of this mode would 
unambigously indicate new physics. Currently the most 
stringent limit is K(r ± ->■ ^7) < 3.1 x 1(T 7 at 90% 
confidence level (c.l.) from the BELLE experiment 0. 

The search for r — > ^7 decays reported here uses 
data recorded by the BABAR detector at the SLAC 
PEP-II asymmetric-energy e + e~ storage ring. The 
data sample consists of an integrated luminosity of L= 
210.6 fb _1 recorded at a center-of-mass energy (\fs) of 
a/s = 10.58 GeV, and 21.6fb~ 1 recorded at ^ = 
10.54 GeV. The luminosity-weighted average cross sec- 
tion for e+er -> t + t~ is a TT = (0.89 ± 0.02) nb 0, cor- 
responding to a data sample of 2.07 x 10 8 T-pair events. 

The BABAR detector is described in detail in Ref . . 
Charged particles are reconstructed as tracks with a 5- 
layer silicon vertex tracker and a 40-layer drift chamber 
(DCH) inside a 1.5-T solenoidal magnet. An electro- 
magnetic calorimeter (EMC) consisting of 6580 CsI(Tl) 
crystals is used to identify electrons and photons. The 
flux return of the solenoid, instrumented with resistive 
plate chambers (IFR), is used to identify muons. 

The signature of the signal process is the presence of 
an isolated /z and 7 having an invariant mass consistent 
with that of the r (1.777 GeV/c 2 9}) and a total energy 
(-E M7 ) equal to \fsj1 in the event center-of-mass (cm.) 
frame, and properties of the other particles in the event 
which are consistent with a SM r decay. Such events are 
simulated with higher-order radiative corrections using 
the KK2f Monte Carlo (MC) generator ^^where one r 
decays into fi^f according to phase space lCj, while the 
other t decays accor ding to measured rates simu- 
lated with Tauola [13jl3j. The detector response is sim- 
ulated with GEANT4 14] . The simulated events for si gnal 
as well as SM background processes El E 
are then reconstructed in the same manner as data. The 
MC backgrounds are used for selection optimization and 



efficiency systematic studies, but not for the final back- 
ground estimation, which relies solely on data. 

Events with two or four well reconstructed tracks and 
zero net charge are selected. The magnitude of the 
thrust vector calculated with all observed charged and 
neutral particles, characterising the direction of maxi- 
mum energy flow in the event |l7| . is required to lie 
between 0.900 and 0.975 to suppress e+e~ — > qq back- 
grounds with low thrust and e + e~ — > /i + ^t~ and Bhabha 
backgrounds with thrust close to unity. Other non-T 
backgrounds are suppressed by requiring the polar an- 
gle (0 m i ss ) of the missing momentum associated with the 
neutrinos in the event to lie within the detector accep- 
tance (—0.76 < cos9 miss < 0.92), and the scaled miss- 
ing cm. transverse momentum relative to the beam axis 
(Pmiss/Vs) to be greater than 0.068 (0.009) for events 
with two (four) tracks. 

The signal-side hemisphere, defined with respect to the 
thrust axis, is required to contain one track with cm. mo- 
mentum less than 4.5 GeV/c and at least one 7 with a cm. 
energy greater than 200 MeV. The track must be identi- 
fied as a fi using DCH, EMC and IFR information and the 
7 candidate is the one which gives the mass of the ^7 sys- 
tem closest to the r mass. This provides the correct pair- 
ing for 99.9% of selected signal events. The resolution of 
the /X7 mass is improved by assigning the point of closest 
approach of the [i track to the e + e~ collision axis as the 
origin of the 7 candidate and by using a kinematic fit with 
E^y constrained to ^/s/Z- This energy-constrained mass 
(mEc) and AE — — \/s/2 are independent variables 
apart from small correlations arising from initial and final 
state radiation. The mean and standard deviation of the 
mEC and AE distributions for reconstructed MC signal 
events are: (m E c) = 1777MeV/c 2 , a(m EC ) = 9MeV/c 2 , 
(AE) = -9 MeV, a(AE) = 45 MeV, where the shift in 
(AE) comes from photon energy reconstruction effects. 
We blind the data events within a 3tr ellipse centered on 
(jtiec) and (AE) until completing all optimization and 
systematic studies of the selection criteria. 

The dominant backgrounds are from e + e~ — > 
and e + e~ — * t + t~ (with a — ► fi^uv decay) events 
with an energetic 7 from initial or final state radiation 
or in the r decay. For these backgrounds, the 7 is pre- 
dominantly along the /1 flight direction; thus we require 
I cos0 H \ < 0.8, where Oh is the angle between the \x 
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momentum in the reconstructed r rest frame and the 
r momentum in the laboratory frame. Backgrounds aris- 
ing from r — ► h^(> decays with the hadronic 
track (h) mis-identified as a /i, are reduced by requiring 
the total cm. energy of non-signal 7 candidates in the 
signal-side hemisphere to be less than 200 MeV. If the 
reconstructed neutral candidate identified as the signal 
7, has at least 1% likelihood of arising from overlapping 
daughters in ir° — > 77 decays, then the event is rejected. 

The tag-side hemisphere, which is expected to con- 
tain a SM r decay, is required to have a total invari- 
ant mass less than 1.6 GeV/c 2 and a cm. momentum for 
each track less than 4.0 GeV/c to reduce background from 
e + e~ — > qq and e + e~ — > processes, respectively. 

The background is further reduced by requiring the 
hemisphere to have no more than six 7 candidates. 

A tag-side hemisphere containing a single track is clas- 
sified as e-tag, /x-tag or h-tag if the total photon cm. 
energy in the hemisphere is no more than 200 MeV and 
the track is exclusively identified as an electron (e-tag), 
as a muon (/x-tag) or as neither (h-tag) . If the total pho- 
ton cm. energy in the hemisphere is more than 200 MeV, 
then events are selected if the track is exclusively iden- 
tified as an electron (e7-tag) or as neither an electron 
nor as a muon (Iry-tag). These allow for the presence 
of radiation in — > decays and for photons from 

7T° — * 77 in — * h^(> l)-K Q i> decays. If the tag-side 
contains three tracks, the event is classified as a 3h-tag. 
We explored other tag-side channels but the sensitivity 
of the search does not improve by including them. 

Hadronic r decays have only one missing v, a feature 
used to purify the sample. Taking the tag-side r direction 
to be opposite the fitted signal ^7 candidate, we use all 
tracks and 7 candidates on the tag-side to calculate the 
invariant mass squared of the missing v (to 2 ), and require 
|m 2 | to be less than 0.4GeV 2 /c 4 for h-tag and 3h-tag 
events and less than 0.8GeV 2 /c 4 for Iry-tag events. 

At this stage of the analysis, 15% of the MC signal 
events survive within a Grand Side Band (GSB) region 
defined as: to EC £ [1.5, 2.1] GeV/c 2 , AE e [-1.0, 0.5] 
GeV. The non-blinded part of the GSB contains 4688 
data events, which agrees with the MC background ex- 
pectation of 4924 events to within 5%. Out of these MC 
events, 80% are from e + e~ — > t + t - , 82% of which are 
— ► p^vv decays on the signal-side. 

To further suppress the backgrounds, separate neu- 
ral net (NN) based discriminators are used for each of 
the six tags. Five observables serve as input to the NN: 
the missing mass of the event, the highest cm. momen- 
tum of the tag-side track(s), cosOh, Pmi SS and to 2 . Each 
NN is trained using data in the non-blinded part of the 
GSB to describe the background and fry MC in the full 
GSB region to describe the signal. The NN output dis- 
tributions of the data (Figure Q are in good agreement 
with MC backgrounds both in shape and absolute rates, 
as are the input observables. The MC signal within a 
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FIG. 1: NN output shown for data (dots), MC backgrounds 
(histograms normalized to the luminosity) and MC signal 
(curves with arbitrary normalization) in the GSB region. 
Lines with arrows indicate optimized cut positions. The prob- 
ability of the data-MC x 2 is indicated for each tag mode. 

2(7 ellipse in the m-^Q-AE plane centered on (toec) and 
(AE), and the MC background interpolated from Toec 
sidebands (|toec — ("1ec)| > 3<r within the GSB and 
\AE — (AE)\ < 3a) are then used to optimize the cut 
value on the NN output based on the expected 90% cl. 
upper limit. The optimized NN cut values are restricted 
to be > 0.5. Within the ±3a band in AE, the MC pre- 
dicts that 66% of the selected background comes from 
e + e~ — > /x + /x~, 27% from e + e~ — > t + t~ and the rest 
from e + e~ — > qq processes. 

With the data unblinded, we find four events in the 
2a signal ellipse where we expect 6.2 ± 0.5 events, ob- 
tained from a linear interpolation of the data in the to-ec 
sidebands. Other polynomials up to at least fifth or- 
der predict the same level of background to within half 
a standard deviation. The agreement between observed 
data and background expectations across the different 
tagging modes are shown in Table [I] 

The relative systematic uncertainties on the trigger 



6 




FIG. 2: mEC distribution of data (dots), the background com- 
ponent of the fit (dotted line) and MC signal (curve with arbi- 
trary normalization) for \AE — (AE}\ < 2a. The % 2 between 
data and the background component is 16.0 for 20 bins. 
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TABLE I: Number of events for data and MC backgrounds 
for the different tags in the full GSB; in the 2a signal ellipse, 
the number of events selected in data and expected from the 
data sidebands; the number of data events selected inside the 
±2<r band in AE; and the respective efficiencies (e). 



efficiency, tracking and photon reconstruction efficien- 
cies, and particle identification are estimated to be 1.2%, 
1.3%, 1.8% and 1.2%, respectively. We obtain a measure 
of the systematic error of the efficiency due to simulation 
uncertainties of the NN input variables by fixing each 
input variable to its average value one at a time, with- 
out retraining or changing the architecture of the NN, 
and re-calculating the efficiency. This has the effect of 
removing each input variable completely from the NN 
selection and gives a 1.9% relative error on the signal ef- 
ficiency Adding these errors in quadrature gives 3.4%. 
As we use 1.2 x 10 6 MC signal events, the contribution to 
the error arising from signal MC statistics is negligible. 

Alternatively, these (and other potential sources of sys- 
tematic uncertainty not necessarily accounted for in the 
above procedure) can be collectively estimated from the 



detector modelling uncertainty obtained by comparing 
data to the MC backgrounds in the non-blinded part of 
the GSB, where the background and signal have simi- 
lar properties apart from tti-ec an d AE. Data and MC 
background statistics as well as signal efficiencies (e) are 
shown in Table [I] inside the full GSB. The agreement in 
the GSB between data and the background MC for each 
tag-mode and their combination validates the ability of 
the MC to simulate these signal-like events. The sta- 
tistical precision of this data-to-MC ratio is augmented 
by using the expanded range wec £ [1.0,2.5] GeV/c 2 to 
obtain a value of 1.052 ± 0.056(stat) ± 0.024(norm) in 
the non-blinded part of the GSB. To be conservative, we 
quote the total 6.1% uncertainty on this ratio, which in- 
cludes a 2.3% normalization error on the product Ler rr , 
as the relative systematic error on the e in the GSB. 

To obtain the branching ratio, we perform an extended 
unbinned maximum likelihood (EML) fit to the m^c data 
distribution (Figure[2l after all requirements but that on 
mEC have been applied. Within this ±2cr band in AE 
the efficiencies for the different tag-modes are given in 
Table IJ for a total value of e = (9.4±0.6)%, where the 
systematic error here includes an additional contribution 
from the AE requirement. A linear parameterization de- 
scribes the background and a double Gaussian serves as 
the probability density function (PDF) of the signal. Un- 
certainities in the mean and resolution of m^c are incor- 
porated into the fit by convoluting the signal PDF with 
another Gaussian with a = 4MeV/c 2 and by increas- 
ing the a of the convoluted Gaussian by 1 MeV/c 2 . The 
quoted limit is insensitive to these variations, however. 

In the EML fit, the number of signal events is given by 
2ha TT eB(r ± — > fi ±r y) and we fit for the branching ratio, 
the number of background events and slope of the back- 
ground. The systematic uncertainty on e is incorporated 
into the likelihood by adding e as a fourth fit parameter 
under the constraint that it follows a Gaussian spread 
about its measured value within the estimated errors. 
This yields the same upper limit as the fit without the 
constraint on e to within the quoted number of significant 
figures. The fit gives B{t± -> ^ ± 7) = (— 5.6±|;1) x 10~ 8 , 
which corresponds to -2.2t.2A signal and 143 ± 12 back- 
ground events. From the likelihood function of this fit, a 
Bayesian upper limit can be derived [Til ]. 

In keeping with established — ^_u ± -j studies |till9|. 
we derive a frequentist upper limit [20j . We generate MC 
samples with Poisson-distributed numbers of signal and 
background events. The expected number of background 
events is fixed to 143 and we scan over the expected num- 
ber of signal events, s. The wec values are distributed 
according to the signal and background PDFs, where the 
background slope is generated from a Gaussian distribu- 
tion with mean and standard deviation given by the fit 
to the data. The number of signal events in each sample 
is extracted using the same EML fit procedure as that 
applied to the data. We vary s until we find a value for 
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which 90% of the sample yields a fitted number of sig- 
nal events greater than that observed in the data, i.e. 
—2.2. At 90% c.l. this procedure gives an upper limit of 
B(r ± -> /i±7) < 6.8 x 10" 8 HJ. 

As confirmation of this result, we also undertake an 
analysis without the NN, having the same sensitivity of 
12 x 10~ 8 for the expected 90% c.l. upper limit. Events 
with a tag-side muon are vetoed but single-track tag 
events are otherwise not classified. Cuts are applied on 
the signal /i momentum, signal 7 energy, 6 m i SS , Pmiss > the 
tag-side invariant mass and AE, and ttiec is required to 
be within 30MeV of m T . This selection retains 10.7% of 
the signal and has a background of 28.5±2.3 events as 
estimated from the sidebands. 

To enhance the signal/background discrimination, a 
likelihood-ratio variable, 1Z, is built from four discrimi- 
nating variables: p^issi ^-E, the difference between the 
signal /i and 7 energy in the cm., and the acoplanarity 
between the signal /ry system and the tag system. We 
observe no evidence of signal and we compare the two- 
dimensional (mEc, TV) distribution of the 27 events in 
data with the background and signal expectations, uti- 
lizing a classical frequentist GLs+b method The 
limit set is consistent with the above value and amounts 
to a 90% c.l. limit of 9.4 x 10" 8 . 
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